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(54) METHOD AND DEVICE FOR RECOGNIZING PERIPHERY 

(57)Abstract 

PROBLEM TO BE SOLVED: To correctly recognize even 
a small object at least. 

SOLUTION: Pictures photographed by a single camera 
while moving are obtained. A recognition processing part 
13 detects an object candidate in the photographed 
pictures and follows the object candidate in a moving 
picture to obtain object shape information from locus 
information. A behavior and posture detecting part 1 1 
obtains the behavior and posture of the camera by using 
the photographed pictures for recognition processing, 
and the pieces of data are used for recognizing the 
object with following information. The part 1 1 converts 
an optical flow parameter obtained from the 
photographed picture to a physical parameter in a three- 
dimensional space. An extension Kalman filter is used 
respectively for detecting a behavior and posture and 
recognizing the object 
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jr„ = h, = (tf V A B C D E FY 



(6) 



(006 2] (3) ^iSi^i-^^^r/W 
IflJtLfciifc, *MS»fc-ett. J£SS*/w-?y7 4* 

10 0 6 3] Ttn?4-)r%9x (±T. tfyf-. 
9A) 14. ZfcfittK4 9*70Mfc£*iS. *r/H4l 
0ff>£-C*3*l<5. *WS«T«fi-CfS9«) 
3oco^«riiSfcJ;U t 3owi5]esg, *^7aT-<0J6 

Eic^-r5*^73?i^OT3ows:. mufjitjutv. 
[oo6 4i m&jftmtt. 

1*9] 

4 + P«a + floAH = fc 4 a+IV 0 (7) 30 

H-iA+«A 



gy-cx. h a liilKiindbT-fes (aT(oS;-c^<o^: 

[0 0 6 5] Sfctfy^V^WW, 
l»10] 

wa + pewa + qt9 = (*s//«)o + «»tf 0 + W 3 (8) 

e-y?ft. pe(mn&&. qotf<*m. ken a 

-YX. h 9(429:^ + 5 ?XT-<DW2 let Stfffitfy 

[00 6 6] ifco-A-gfttt, 
(ftl U 



«s + P*«3 + 9*^ = (*♦ VIU) sin w, + + w 8 (9) 



rz-CVI4*P5ia-C*>!3. l (frliD-zKOffili^-y 
>K *OI4lWSn-/uft t P<M4#S&», q<M*'< 
*£ft. k tttfMMoSftJ: u 3(0«{b¥i«0B|«S 
H. W3(4iil&GMi<7>Kyi/'l'X % h ♦Mt2*y'f *5 
? x-CtOW 3 lc 4 6§ffio~/^tCfc5. 
[0 0 6 7] *^<0^'J y^li«ffiT-#5i:i5!£i-5 

[ftl 2] 

*=W» (10) 

[00 6 8] £f>IC«#lSMi*»tt. 
[ftl 3] 

c = a + W< (11) 



-CW c liH^Etc 4 * *&S / << Xffc S„ 
[0 0 6 9] $f>IC3-^f)l4. 
Iftl4] 

u>i = Wi (12) 

40 rc-cwii4ilgsiiai!bic454!is/-rx-c*)5o 
loo7o] $e>ic *>7^-c<7)Kffiic^i-5*y v 

(ftl 5] 

d(6H)idt = 6H=a 

50 £<ble jMvOfc&KMLT, *^<7i0(fi)#i*(*(0 



(10) 



17 



[0 0 7 1] *H/-f-*-3v?x*7*i'KNlT 

hb<D&& (6o©3Mft'<7^-:?£4o<0|6]f /<7> 
-#) h9 99 10 

[0 0 7 21 (4) t-Frj #/U7P-isJ:tf7B-/< 

*1\ 77*7->7> • ^7->7V • 7 (Laplacian 
Gaussian Filter)Srffl^-CB«feO#«^^H$Jl'5. 

[0 0 7 31 fliiSfgOtfTr 4 */u7a-/<7>-^Sr* 
y„ = (C7 V A B C D 
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ttK*i«Hc«rei6. SfcftJWfcTtt, HiiWfil:. 

[0074] tUTttiU©* (2) (3) #, amiBo 
7n-/<7^-^U, V, A, B. C. D. 

*-*fcJ:tftroii«<t»©ffifi (u(x. y ), v(x.y). 

x, y) mnztii. ~o>mtt. Ttvur-h 

utliers) £8 *0WKlMHIKi5fcor* 
[007 5] (5) i£56*/U-ry7-</U^Wflt(S 

X. mmhnmk^t Y^y vtt£ilTfcJ:5l£l6*3 

: 

HS16] 

B F c ui) T (13) 



[0 0 7 6] ***»fll'e*»£J:9*ft6'<* 

S. = (d S c tJi «Jj <4» * * A'tf (14) 



[00 7 7] 
Ufcl 7] 



g£"<* h/Hi, * (6) X'^hi,xof£-sm^mv 

nmmzg'I^Xi'XT- A©*«r*»fkt6r it?, £ 30 
[00 7 8] (6) 

SGI 02 V—PXt— > 3 XJCTMATLAB^- 
•yay5<73S IMUL I N K*-y a-^^fflV>t^(ifc t 
fc (*it-t*ftiS«) 0 A^T-^li. l£«0CCD5M 
7lcio#(bixfciift?i)t»i55-fe>"^T-^i:T?*)'). 40 

[0 0 7 9] (£ffl LfciitfelM' *(J N 256X240tT 
^•fe/i'T'fc'?, ■tMM*l'-Mil 5Hz (15tt/ 
W -CfcS. BtfcWtt, i$iim4km/h?*fWC 

[0 0 8 0] E8(0^7 7li, l£JS»^TV7-<^IC 

xitotHMzty** (£#) t. -fcvf-cMfcLfc 
^y^ft (**) i?rH:«tT^LTv>4„ KtkaWtt 
I*ft0. 25#T'*>9. 8itil<DWiUtl&XhZ>. 08 
Offllfctt, ffiffe?iJ^68fcLOG7^?-«lg&tf>7 50 



U-A-e*>6. «$fcJ:0 < a!lSlw±5 2o(07'Cyi±fi 
[008 1] 09K*-f«t5lc, tt(Uft«io^*WK«r 

[008 2] c<offiis<oisBii, *tta-e«RLfc*sa 

[00 8 3]E10I±, m<D&iti%t}i'<7*-fi<»fe% 
fe*$r^ttv^5„ ziibn&%fci>> «w>&fc*CMS 

S*|6]*ii*7«7tticoft«) 
I0084] jetJbtC. *7*r^*/U7n-^b*if*i!l 

[0085] B3icis»), ^nmfm<ommmtams. 



(11) 

19 

[0086] m*)\zM)xtz.mv>mwM]isite 

EE) j»sjft*?>ixSo 

I0087] £(bK, SlW^>7>f;^fi^ 10 

[oo8 8j ^s.m<ommirmmit. BtftSrffl^ 
%n<Dify^\cM7LX, mm 

[0089] • 3?B£UigH 1/WtfcLfcr-* 20 

[0090] rmmmnsMi *ic jamwa* 

[009 1] rji$TO«a-e*PWk*iJ:(J%> 7$ 
»##&*lfc. jEBfttt (geography) W»{CoV^Ttt» 
l»W|-efcoTiiB«>ffiiO«*BJrc#6. £*SJS 

14. lttroHftlCj:oTttJj»//l)*ttKL**jrc*i!e 30 

T»J: 5lcaSft»M. WitfftfMBHcfefcoTB** 
**Kra*t*ifclcJ:9. ajtftaftJ&afrtt*. 
[0 0 9 2] ftBttlctt. i!fc®±T-ro*t**<<:/ K<r> 

**•», aiftttJ^a^bassTaasftaaa* 

V<r>%m (*>7) (0#»(ooveiDent) 
WrfW^MliBl£J:9EiiT-£S 0 MffiOftWlM (nove 
nient) ttii««±#/f V h KTWtt-efc 9 . ROBM L 40 

-f/H?*s#aiCfflV>f>n5. WT, BS«til*£9ttili 
[0 0 9 3] Z<Otm*mtt. ±B«)*»J3J:a«S»«: 

♦Bur. aasaKS^p-c. Ei3oKa*{isgi5i 3 
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SrttW-f*. cr-cttlW*©******. KB* 9 

[0094] 01 1 t O0Hlfe«f , IC»*#fe 

*jWteH*iifc*1-*. KWMRtttt, HIM 

[0 0 9 5] t 04>&Mtft(MMoatt#Httdh6. 

ftfflia (to-ti) . «*tfww>mic*««>7u- 

[0 0 9 6] Ml llifcHT, AWl±. fttttf-rVr-tf 
ISE,fc9±:frlc*>*i:te>0ii5*T'fc5 o xfptt. 

[0 0 9 7] -tr-C. *1H0B*-ert, *H#-f:/M> 

>h«HfttKPWF*#*)54WKt<&. rem Hi 

fttf«tK #^>HMbiJj»6*ft5rt#-jRW-c*> 

t*JT\ »*©J5*flMII:*ft5fe«J: LT, BB«>&a 

■«nfe4^«)ft«««»«*ft?>ii6. at. mtx<D 

[0 0 9 8] 4*5. Bl Wft*#tLT, 
tt^*V^o-CttftV»et4rJB*L-ti»4. 

[0099] ftic. mi 2t#siu satJaaicfcv^x 

*K)*5j:W!6fiMS*«: ^<oj; i tcfl JJB+ 54»«rRW1- 
5. 0l2O*Jblcii, XR0>aftKtt£j&ratUft*5« 

Vh-Cli, B«Lh»M3Srifil©«*** { *ftoTV»4r 

[0 1 0 0] 01 2*»6W?)*»4J:^IC, H^Wlitti 

4»ftW»lltl*»*lft^. iitt^+tB*. 3-. n- 
/U. tf9^ft^«tftft1-6A>^-C«>6. 
[0101] $e>lc. Bi 2«:l»JHt5t, WS^wH 
jftt*ifi±©jS:tHi;J:?l£±TLT^*. w4x«i*W 

[0 10 2] -tCT*. *H«»ffi-Ctt, 

it. mi 2<D«±cDi«fA>t 5 . j«bt»»iii!8ai-6ia 
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<nl i ic lx* / y&mtm Stffctf'i > h<o 3 ftx 
[0103] £ <blcE l 2 ©£{9l£fl*-t-*igRiiiS-e 

l&«#£ft> lK«3B#KHSii«. c.*ife«>Wlltr*Mi 

[0104] s«$iaaT-iijii^/'<xoK#t>sit5„ 
>rxicgt&-e*>*K ^»o«Jt-e*>5. *gtBjgtt?(i, 

[0 10 5] fclC, E3»CJ|r>. *SJ6^«|(0|ie*«5« 

i&sstess&i 3ic. »s«5^ajfflic« 

&<r)*/l^r>7 4/l>9tii®tthtxX^&. *LT, Cil 20 

[0106] n*WkVM(a&tkM>A>-vy7 4M 

IC y 7 h !>x7 #J|C4$ £ i\X i J: V \, 
[0 10 7] BBftlttl 3lCA^£*l5iI<fctt, J$S 

ffittn|BW*/Uvy7-f/U^^«figLTV^. fcrt/l^ 
mbhX<io ziih<r)f~9 

tfmztix* fetmrnwtywom^fr mm 

Wit) tf 5 #*>e>iiS. CW£«f-**rffl^T, n#« 

[0 10 8] n+lftB0fffc&tt8«1MI*qtjl£tl 40 
/u#*»«(create)*ll«. flltf! Lfc«fc ? IC, fl*.tfB 

mx-&&mmkgt£zmt>w-gtom\z&%iiK 

LT, fffc>SrtlH|oMh9<Htt$n«. 

[0109] ht>m<mm>%&Kttmm 

TV tfc# fir* V 7 A- 9 li<&7 (terminate) $tli 0 
[0 1 1 0] 01 3tt, #HffiJB8gKifcofc&S£&<7> 
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«tt****n'"c^6. &^77T-ii, ftftjMKtiam 

WpgfrCVtfi. *fcSt>T©^77|ciiii8S*)E©«i 
[0 111] ^7 7*©i#w*Aa>&atfa«WM3*i 

t^s. s^oipic, iimnttftBii. rs&wis/f. 

5. ««fll*%*i3J:V3cSLT. toftiS 
[0 112] «±KRWtfcJ:5t, #ISi6^flgTli> 
a^*«iW, ttv^MtTBMMfrBltL-Cvi 

y MrBBiotf-f * h fco»Mlc*#ft**» 
il*H&8«rfH<0T-. ftfteBfM»-C#£ 

WWfc** <*iiT»bnfc2ttoBfcw**tttM-S 
«^ttt^6iStTfc5„ «JLLfc9, 

[0 113] 3 e>K*£tt#ftli. UT\zmt5£i 
Ic. BBt»«*Ofe^ififiUTi»*i:#. +4i?%H 

*©B«3M*a«*Sv*fc#ic*«-e#>6 

R«£I£#T#*) . 

[0 114] BBtTf, BBfeJ^BftttftttftS 
«*A*»Brtlc*6fc+*. *SWB*-ett, 

1-6. A0#Blctt, B«A#l«Sr«»-C«>5Ci:**Bt> 
ixiSSlc (m«n*«)&«rEtt« | B»<6i«) /]»* 

[0 115] KB£WtAOgU£2*!S*tt£Jlh-Ci>ft 
tf, ®«A?rftS«5<?l*6i:t, **A»*y5?»oW» 
A<:BlM-«. i6»©B*t L-T, fiS«AWiij$AiBB 

5. »«A*5BBA»fe!5fflLT^ntf. WCAHt 
*ISlcPS^«5T#)5i:*i]Wr-t-So 
[0 116] ioi?lc, **lfeJg«lT<i, K*4MRtt 

Tt>, fcOfcit-mWiBlMltRttL, 
i«Et^*»5«»fet«2£1-5. CixiciO, fftfetffiB 

[0 117] ftlC. *B»»BK*JK, 
?»i5fi!fil6)±Sria5fc*lcli. «3«:fefili<7)fi±,StS 

ftofc»Ktt±T*rtl»BBttB«**«ai-*itfJ:v» 
ICfc^Tfc|Ii]#TifcS. 

[0 118] «*tf, El 3lrWV#R?-r*t. 
IWWi«58 0cmT*6OC»lT, 9Dt»CHfo 
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[0 119] »±K*Ht6^ffi©»#«ga«filCO^ 

[0120] mm& : 8i&tt*m<r>m& 
s&momk-wMx-hz. *xm> mmm io 

[0121] Mtt>£#cH?*ift 

[0122] *fc»!t»t«:l6]B+6wtKJ:9. it 

i o 1 2 3 ] xmmmv&mmzm ix 3 30 

[0 12 4] SfettBtiQJPJatttttt. tmift-pJH* 
[0 12 5] £P>lc. 

LTfcJ:v\, lO^-ctt. Ea*y5*4rict>**W«r 40 
[0 12 6] fcfcfc, *«9lT»tt. *>5i»ffo»!p# 

[0127] *fc, *«it»tt-ett. fliattKKoa- 

ittm&nfrizhx. %&x*m<»-i&&k m% 
[0128] -tt£t>h, *mw\<»temts t*y% so 
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%mzm^bhxt):\>\ 
[0129] 9*hmb 

ft) #Bft£*i4. -a*|b*JePT*ffMftatfft>ft 
±T'#4. 

[0130] Sfejw, *«9iw#jrolg«tt, iti8*)£& 

[0 13 1] *3S^<0»J<OSS«tt, 

fitmtzzwimiibhz. *mxt*> ±&iit 

fiJJ8£ft4 (Hi 0#JS) . 
[0 13 2] ZZX, i}/y$<n%mmt, 

aa-r^^w-oT'fcs. ft*, wjyws 

[0133] RkK**ti0ftmEftfl*K9l Lfc. 4 

*mitm<nmxnii&ztixi>±<, titms 
tffrmmixf-tz&fti-z. 

[0 134] *fc. **WoiSftj»*«r*i:»t>TI!yH 
1-4. 

[0135] **wcj:*itf. Sia»a«aic*5^-c« 

5. * * 7 ro»»itt#/J» $ ^ t # ^iB»fe^K(H/i5/j> 
4v»i#tlSI«-C*»*. 

[0 13 6] **W(ii«tixtf. iteiiElfJ&gwjaiSt L 
[0 13 7] *«WIIJ:<itf, 7*»Ki<J^t8 
<r>#th*t LXUmizm^bhS. ZblzttyZtot 

n/y^mz&^xma&m^noztx, &mm 
*[Si±-c#4o \>hhh. m&mmbhzboo. 
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* / 7 *»<75*£ffl V >T t> <fc V \ 
[0 13 8] *£33lcJ:fttf, it&SHgWi&K&Slcffl 
V>e>il$fc*tfT-fc<, §^<0&&l£fc65M7*I!)*J«t 

[0 13 9] SBWICfcfttf, *>7$SifcJ;r/3|?£cD 
^tHlc, «|giS*lcADx.T-fe>f-?r|iJffl1-iwi:lcJ; 

[0 14 0] *»WKJ:ntf. *M7*f)fcJ:V$££ 

[0 14 1] ::ftl«*9l»lKfc»*©-o-efc6. 

7LbhZ>i>\ ^-7 , -f^*/U7a-li7c*SSiICgS^V^ 
£fcffilC*7'7V2"i'7P-£SfcLfc 
iLTt. ^^fl/l^n-liS* 2&5tiItfe±roT 

t, *«WdJ:tUi. .tiSLfci^, 3&S!§&-C<D 
±£06 r 

[0 14 2] **iflfcj:*itf, #*7$»fc«tyg£© 
»?fcS7n-'<7*-*<0^£»j§£fT9Ci:#-t? 

[0 14 3] *»WCJ:iitf. *>7#»Bt«ii«4g 

[0 14 4] tettsgS&gT'fc^itll^ 
*!igW*t:o*-'i'-7^7^/i'^4rfflv»-5ctic«t»3, :r 

T-t / << mmz&mx-z 5. 40 

[0145] ^micxtm. isa*aafflott»w*^ 
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vyyjjvmmnzmix, ma&mtozm 
ixm+zzttzx')* mitt.* t%i\zm<oto 
tozmKmx'Zs. 

[0 14 6] *3e9Hciftii. £fflfc£fi»<DBi*£ic# 
«U #®®t$.<n%*£r>^x&&smi:'a : )^t\zi. 

[0 14 7] *36Wc±nif. §8ttfc*i LTfcMi* 

»WIMi«flffl ix 3 ft7ye@£ifc£l-sr fctf-c* 
[0 14 8] *l6^lc±iili, Si2KKlcJ:9*i5i*fF* 

[0149] *mtxm. utymmxtm 

[BBOffl*4tt9i] 

[SI] fl6*tt«©BMMKtiptH-C*5. 

[@2] xxmmtoBmmm&mnzm 
i&^i-y'oy^mxhi, 

[03] 02*<OKK&g£Sro«J*£*-f0-Cifc 

[@4] ja»attfefflv^*/7*«*5«j;t/g?»«tij 

[05] ■ 30BMSItta*IHeftWB0t9-t 
0-ci>5. 

[06] SMJ>*^i»«>£||*jjWB|-C*>6. 
[07] *Wtt«*5j:t;*y7a«lr*tBr*>5. 
[08] WHIWfcLT»e7*A«>»e***ST 
0Tfc-5„ 

[09] «Hi»r««i«a5H9t»45fc*»e , 7*ft 
[0ioj aa^****^*/^-*©*^ 

[011] *HifeJ8Airoi!Btoa8£fflv 'fclttNMMft 
[012] 01 i©*aa^»*>fJ|WMaJ:t«6IMt 

[013] Jttft0>B*£ft«)fl*fl*'*B|-C*>&. 
[**©RW] 

1 CCD*/ 7. 3 »B^«i-fevt, 5 
SflL 7 7*<f*7*M\ 8 9 7*^:x 

11 mii-vmmm* 13 less^m 
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7ny h^-Stoftt 

(51) Int. CI. ' SffiS'JIE-^ 
H0 4N 7/18 



F I 

H04N 



yy/<—# 7t-~7* 7*=.*— 
5000 >ny ^/^-yf 



7/18 E 
G 
J 
K 



F*-A(£#) 2F065 AA01 AA24 AA31 AA37 AA51 
CCOO DD03 FF04 FF28 GG10 
JJ03 JJ26 QQ01 QQ31 QQ33 
SS13 SS15 

5B057 AA13 AA16 BA01 BA02 BA11 
BA19 BA21 CA01 CA08 CA12 
CA16 CB01 CB08 CB13 CB16 
CD14 CH08 DA07 DA08 DA11 
DA16 DA17 DC08 DC09 

5C054 EA01 EF06 FC13 FD01 FE24 
FE26 GB15 GD04 HA26 HA31 

5L096 AA09 BA04 BA18 CA04 CAM 
CA27 DA03 DA05 FA64 FA66 
FA67 FA69 GA55 HA04 HA05 



